US News and World Report Cancer Hospital Rankings: Do They Reflect Measures of Research Productivity?

CONTEXT Prior research has faulted the US News and World Report hospital specialty rankings for excessive reliance on reputation, a subjective measure of a hospital's performance. OBJECTIVE To determine whether and to what extent reputation correlates with objective measures of research productivity among cancer hospitals. DESIGN A retrospective observational study. SETTING Automated search of NIH Reporter, BioEntrez, BioMedline and Clinicaltrials.gov databases. PARTICIPANTS The 50 highest ranked cancer hospitals in 2013's US News and World Report Rankings. EXPOSURE We ascertained the number of NCI funded grants, and the cumulative funds received by each cancer center. Additionally, we identified the number of phase I, phase II, and phase III studies published and indexed in MEDLINE, and registered at clinicaltrials.gov. All counts were over the preceding 5 years. For published articles, we summed the impact factor of the journals in which they appeared. Trials were attributed to centers on the basis of the affiliation of the lead author or study principal investigator. MAIN OUTCOME Correlation coefficients from simple and multiple linear regressions for measures of research productivity and a center's reputation. RESULTS All measures of research productivity demonstrated robust correlation with reputation (mean r-squared  = 0.65, median r-squared = 0.68, minimum r-squared = .41, maximum r-squared = 0.80). A multivariable model showed that 93% of the variation in reputation is explained by objective measures. CONCLUSION Contrary to prior criticism, the majority of reputation, used in US News and World Rankings, can be explained by objective measures of research productivity among cancer hospitals.